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Abstract — This paper considers the leader-follower control 
problem for a linear multi-agent system with undirected topol- 
ogy and linear coupling subject to integral quadratic constraints 
(IQCs). A consensus-type control protocol is proposed based on 
each agent's states relative its neighbors. In addition a selected 
set of agents uses for control their states relative the leader. 
Using a coordinate transformation, the consensus analysis of the 
multi-agent system is recast as a decentralized robust control 
problem for an auxiliary interconnected large scale system. 
Based on this interconnected large scale system, sufficient 
conditions are obtained which guarantee that the system tracks 
the leader. These conditions guarantee a suboptimal bound 
on the system tracking performance. The effectiveness of the 
proposed method is demonstrated using a simulation example. 

I. Introduction 

Theoretical study of distributed coordination and control 
for multi-agent systems has received increasing attention in 
the past decade, due to its broad applications in unmanned 
air vehicles (UAVs), formation control, flocking, distributed 
sensor networks, etc [1]. As a result, much progress has 
been made in the study of cooperative control of multi-agent 
systems [2], [3], [4]. 

Efforts have recently been made to consider the leader- 
following consensus problem. It was noted in [5] that the 
control problem becomes much more complex if only a 
portion of the agents in the group has access to the leader. For 
example, the leader-following consensus problem for higher 
order multi-agent systems is presented for both fixed and 
switching topologies in [6]. In [7], distributed observers are 
designed for the system of second-order agents where an 
active leader to be followed moves with an unknown velocity, 
and the interaction topology has a switching nature. The 
consensus-based approach to observer-based synchronization 
of multiagent systems to the leader has further been explored 
in [8], [9]. 

The majority of leader following consensus-based control 
problems currently considered in the literature are focused 
on systems of independent agents. In many physical systems, 
however, interactions between agents are inevitable and must 
be taken into account. Examples of systems with a dynami- 
cal interaction between subsystems include power systems 
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and spacecraft control systems [10]. While in interacting 
systems decentralized control schemes can be used, in the 
examples mentioned above only relative states are available 
for measurement which poses an additional difficulty when 
using decentralized control. Hence, consensus based control 
strategies using relative state information have application in 
these problems; e.g., see [11]. 

In this paper, we are concerned with the leader-follower 
control problem for multi-agent systems coupled via linear 
unmodelled dynamics. Compared with the existing work in 
the field of the leader-follower consensus problem, interac- 
tions between the agents are regarded as uncertainty and 
are described in terms of time-domain integral quadratic 
constraints (IQCs) [16]. The IQC modelling is a well estab- 
lished technique to describe uncertain interactions between 
subsystems in a large scale system [12], [13], [17]. 

The IQC modelling allows us to analyze the effects of 
interactions between the agents from a robustness viewpoint. 
In this respect, the recent paper [22] is worth mentioning, 
which considers robust consensus protocols for synchroniza- 
tion of multiagent systems under additive uncertain pertur- 
bations with bounded Hoo norm. Since the IQC conditions 
in our paper capture uncertain perturbations with bounded 
L2 gain, we note a similarity between the two uncertainty 
classes. However, thanks to the time-domain IQC modelling, 
our paper goes beyond establishing a robust consensus. It 
develops the optimization approach to the leader-follower 
tracking problem, which provides a guarantee of perfor- 
mance of the leader-follower system under consideration 
(note that [22] consider a leaderless network). Namely, we 
pose the leader-follower tracking problem as a constrained 
optimization problem in which we optimize the worst-case 
consensus tracking performance of the system, as well as the 
cost associated with protocol actions. Our interest in robust 
performance guarantees is inspired by recent results on the 
distributed LQR design [21], [19]. 

The main contribution of the paper is a sufficient con- 
dition for the design of a guaranteed consensus tracking 
performance protocol for multi-agent systems subject to 
uncertain linear coupling. To derive such a condition, the 
underlying guaranteed performance leader following control 
problem is transformed into a guaranteed cost decentralized 
robust control for an auxiliary large scale system, which is 
comprised of coupled subsystems. The fact that the sub- 
systems remain coupled after the transformation constitutes 
the main difference of our approach, compared with, e.g., 
[18], [19], where similar transformations resulted in a set 
of completely decoupled stabilization problems. Coupling 



between subsystems poses an additional difficulty compared 
with [18], [19], which stems from coupling between the 
agents. It is overcome using the minimax control design 
methodology of decentralized control synthesis [12], [13], 
[17]. 

The paper is organized as follows. Section II includes 
the problem formulation and some preliminaries. The main 
results are given in Section III. In section IV, the illustrative 
example is presented. Finally, the conclusions are given in 
Section V. 

II. Problem Formulation and Preliminaries 

A. Graph theory 

Consider an undirected graph Q — (V, £, A), where V = 
{Vi,V2,--- ,Vn} is a finite nonempty node set and £ C 
V x V is an edge set of unordered pairs of nodes. The edge 
in the edge set of an undirected graph means that nodes 
i and j obtain information from each other. Node i is called 
a neighbor of node j if £ £. The set of neighbors of 
node i is defined as Ni — £ £}■ G is a simple 

graph if it has no self-loops or repeated edges. If there is a 
path between any two nodes of the graph Q, then the graph 
Q is connected, otherwise it is disconnected. The adjacency 
matrix A = [aij] £ R NxN of the undirected graph Q is 
defined as <Zjj = ay, = 1 if £ £, and ay = dji = 

otherwise. The degree matrix T> = diagjdi, • • • ,<1n} £ 
H NxN is a diagonal matrix, whose diagonal elements are 

N 

di = Yl a ij f° r « = 1, • • • , N. The Laplacian matrix of the 

graph is defined as C = T> — A. It is symmetric when Q is 
undirected. 

B. Problem Formulation 

Consider a system consisting of N agents and a leader. The 
communication topology between the agents is described by 
a simple undirected connected graph Q. Dynamics of the ith 
agent are described by the equation 

±i = Axi + BxUi + B 2 ^ X A-) lo -Xi(-) lo). (!) 

where the notation ip(y(.) | ) describes an operator mapping 
functions y(s), < s < t, into 5R™. Also, Xi £ W 1 is the 
state, Ui £ 5R P is the control input. We note that the last 
term in (Q]i reflects a relative nature of interactions between 
agents. 

Let I/2e[0, oo) be the space of functions y(.) : [0,oo) — > 
5ft" such that J Q \\y(t)\\ 2 dt < oo, VT > 0. 

Assumption 1: <p is a linear operator mapping 
L2e[0, oo) — > i2e[0, oo) which satisfies the following 
integral quadratic constraint (IQC) condition [16]. There 
exists a sequence {ti},ti — > oo, and a constant d > such 
that for every ti, 



\\v(y(- 



l dt < 



\y\\ 2 dt + d, Vy e i 2e [0,oo) 



In addition to the system (03, suppose a leader is given. 
The dynamics of the leader, labeled 0, is expressed as 



x = Ax , 



(3) 



where xq £ 5ft" is its state. We assume throughout the paper 
that the leader node can be observed from a subset of nodes 
of the graph Q. If the leader is observed by node i, we extend 
the graph Q by adding the edge (0, i) with weighting gain 
cji = 1, otherwise let gi = 0. We refer to node i with g,; ^ 
as a pinned or controlled node. Denote the pinning matrix as 
G = diag [gi, ■ ■ ■ , gjv] £ $l NxN . The system is assumed to 
have at least one agent connected to the leader, hence G^0. 

Define synchronization error vectors as = xq — Xi, i = 
1, 2, . . . , N. Dynamics of these vectors satisfy the equation 

e, = Ae t - BxUi - B 2 ^ a^(e. ( (.) \\ -e^.) (4) 

In this paper we are concerned with finding a control 
protocol for each node i of the form 

Ui = -K{^2 aij(xj - x^ +gi(x a -x^}, (5) 

where K £ 5ft pxn is the feedback gain matrix to be found. 
As a measure of the system performance under this protocol, 
we will use the quadratic cost function (cf. [21]), 

N 



poo I 

i=l j£Ni 



■ gie' i Qe l + u'iRuAdt 



(6) 



where Q = Q 1 > and R = R' > are given weighting 
matrices, and u denotes the vector u = [u[ . . . u' N ]'. Each 
addend in the cost function © penalizes the ith system input, 
the disagreement between the ith and the j th system states, as 
well as the disagreement between the leader and the pinned 
agent which can observe the leader. 

The problem in this paper is to find a control protocol (0 
which solves the guaranteed performance leader following 
consensus control problem as follows: 

Problem 1: Under Assumption Q] find a control protocol 
of the form (0 such that 

sup J(u) < oo. (7) 

3 ° _. 
It will be shown later in the paper that (|7) implies 



|e l || 2 di<oo Vi = l, ...,N. 



(8) 



(2) 



The class of such operators will be denoted by Sq. 



Hence, solving Problem Q] will guarantee that all the agents 
synchronize to the leader in the L 2 sense. 

C. Associated Guaranteed Cost Decentralized Control Prob- 
lem 

In this section, we introduce an auxiliary guaranteed cost 
decentralized control problem for an interconnected large 
scale system. Our approach follows [18], [19], however here 
it results in a collection of interconnected subsystems. 



Taking the linearity of the operator <p into account, the 
closed loop large-scale system consisting of the collection of 
the error dynamics (@) and the protocols (0 can be written 

as 

e =(I N ® A)e + ((£ + G) ® {B x K))e 

-{{C + G)®B 2 )<S>{t) + {G®B 2 )<S>{t), (9) 

where 



'1 c 2 



=ATJ > 



*(t) = b'(ei(.) |S) ?'(e 2 (.) |*) ... ^'(e^(.) |*)], 

and ® denotes the Kronecker product. 

It was shown in [14] that if the communication graph Q is 
connected and has at least one agent connected to the leader, 
then the symmetric matrix C + G is positive definite, Hence 
all its eigenvalues are positive. 

Let T E di NxN be an orthogonal matrix such that 

T- 1 (C + G)T = J = diag[Ai,-- - ,Ajv]. (10) 

Also, let e = (T- 1 ® 7 n )e, e = [ei ... e^r]' and $(t) = 
(T -1 ® 7„)<I>(f). Using this coordinate transformation, the 
system (O can be represented in terms of e, as 

£ =(I N <8 A + J ® {BiK^e - (J ® B a )*(t) 
- ((T^GT)®^)^*), 

where 

\ 



(11) 



/ ^(EC^wois; 

3=1 



*(*) 



A' 



/ <p(ei(.) IS) \ 

V vM.) IS) / 



Here we used the assumption that cp(.) is a linear operator. 
It follows from (Qj} that 

ei = Ae i + \ i BiKei + ^y^{T- l ) ip g p T pj B 2 ip{e j {.) |S) 



^Z{T-\ P 9 v T vl ~\)BMs^ |S), 



(12) 



Then (fTTT i can be regarded as a closed loop system consisting 
of N interconnected linear uncertain subsystems of the 
following form 



ii = Aei + Buiii + Ei£i + Lirji, 



(13) 



each governed by a state feedback controller ui = Ke^ Here 
we have used the following notation 





= IS). 




(14) 


Vi 


— Hi ■ ■ ■ ii-i ii+i ■ 


• &]', 


(15) 


B u 


= Ai-Bi, 






Ei 


= (fi,i — Xi)B 2 , 






Li 


= B 2 [fi,il, • ■ • , /z,(i-i 




■ j fi,Nl], 


fi,j 


= T i P g P T P j . 







According to Assumption [T] the linear coupling ip satisfies 
the integral quadratic constraints (f2). This implies that the 
following two inequalities hold for all i = 1, 2, • ■ • ,N: 



' \\ii\\ 2 dt< [ l Weifdt + d, 
Jo 

ti 



(16) 



IM| 2 *< / y)||ei|| 2 * + (JV-l)d. (17) 

It follows from ( TToT l and ( fTTI i that the collection of uncer- 
tainty inputs £j, r}i, i = 1, 2, • • • , N, represents an admissible 
local uncertainty and admissible interconnection inputs for 
the large-scale system ([13k see [12], [13], [16], [17]. The 
sets of admissible uncertainty inputs and admissible intercon- 
nection inputs for the system (fT3T > will be denoted by H, n, 
respectively. Then the above discussion can be summarized 
as follows: If ip satisfies the conditions in Assumption Q] 
then the corresponding signals (fl4l . ([T5T l belong to 3, n, 
respectively. 

Next, consider the performance cost ©. It is possible to 
show that 

/"CO 

J(u)= (e'((£ + G)®Q) e + u'(I<g)R)u)dt. (18) 
Jo 

N poo 

= Y] / (X l e' t Qe l + X 2 i e' i K'RKe l )dt. (19) 
l= i Jo 

Thus we conclude that 

J(u) = J(u), (20) 
where u = (u^, . . . , v! N )' , Ui = Kei, and 

= J2 (MG^ + X 2 iUiRui)dt, (21) 
i=i Jo 

Now consider the auxiliary guaranteed cost decentralized 
control problem associated with the uncertain large scale 
system comprised of the subsystems (13[ , with uncertainty 
inputs (fl4l i and interconnections (15[ , subject to the IQCs 
(TToT l. (fTTI i. In this problem we wish to find a decentralized 
state feedback controller u = (v! 1: . . . , u' N )' , Ui — Kei such 
that 



sup j{u) < 00. 
H,n 



(22) 



The discussion in this section can be summarized as follows. 

Lemma 1: Under Assumption [T] if the state feedback 
controller u = (u'i, . . . , u' N )' , u, = Kei, solves the aux- 
iliary guaranteed cost decentralized control problem for the 
collection of systems (fT3l l and the cost function d2"Tl >. then the 
control protocol (0 with the gain matrix K solves ProblemQ] 
Proof: Since the state feedback controller Ui = Kei 
solves the auxiliary guaranteed cost decentralized control 
problem for the collection of the systems ([T3~t , then we have 



sup j(u) < c. 



(23) 



Also we noted that every signal ip which satisfies Assump- 
tion Q] gives rise to an admissible uncertainty for the large- 
scale system consisting of subsystems (13[ . This implies that 

for any ip G So with u = (C + G) ® Ke, we have 



J(u) = J(u) < supj(u) < c. 



(24) 



It implies that the control protocol (0 with the same gain K 
solves Problem Q] ■ 
Note that since C + G is positive definite, then (0 follows 
from © and JTSt. 

III. The Main Results 

The main results of this paper are sufficient conditions 
under which the system (0, (0 tracks the leader with 
guaranteed consensus tracking performance. 

Theorem 1: Let matrices Y = Y' > O.Y G 5ft" x " 
and F £ 5ft px ", and constants 7T< > 0, 0, > 0, i = 
1, 2, ■ • • , iV, exist such that the following LMIs are satisfied 
simultaneously 

-.1/2 



Z, 
F 

q\ I2 y 

Y 
1®Y 



F' 

1 E>-1 



Y 


i'<g>y 














±1 










-er 1 



<o, 



(25) 



where 



~^R~ L o 

-I 







1 = [1 ... 1]' g 5ft w ~\ 

« = (E^) 1/a . 



and 

Z< = Ay + FA' + A t F's; + X L BiF 
+ (Tri 1 ( Pi f+67 1 <g)B 2 B' 2 , 
9 4 = diag[0i, . . . ,0j_i,0 i+ i, . . .,0jv] ® in- 
Then the control protocol (0 with A' = FY^ 1 solves Prob- 
lem [T] Furthermore, this protocol guarantees the following 
performance bound 

JV JV 

sup J(u) < J2(Tn+6i{N - l))d + ^e^(0)r^ 1 e l (0). 

a ° i=l i=l 

(26) 

Proof: Using the Schur complement, the LMIs d25l l can 
be transformed into the following Riccati inequality 



AY + YA 1 



2 2 



B 2 B! 2 + Y[Q l + (n l + 9 l )I]Y 



XfF'RF + XiF'B[ + \iBj_F < 0, 



(27) 



Consider the following Lyapunov function candidate for 
the interconnected systems ([PTl i. (TToT l. (T% : 



JV 



(28) 



For the controller ui = Kei, we have 

1M( \ N N 

dV(s) 

■ = z Z^ e ''- r P*-°2?i-r-^ 

i=l 



JV 



i v J v 

2^ £ ' i F- 1 p^ 2 e i + 2^ £ ; : y- 1 L I 7 7j (29) 



»=i 



+ E e * [ F ~ V + hB x K) + {A + X.B.KYY- 1 

i=l 

Substitute F = KY into the Riccati inequality ( |2"7| i. Then 
after pre- and post-multiplying ( |27| i by Y^ 1 and substituting 
it into j29l ), we have 

dV(e) 



dt 



< -J2(e' i 7rr 1 P ^Y- 1 B 2 B' 2 Y- 1 E i 



- 2e' i Y- 1 Pl B 2 & - tt 4 || & f +vr 4 || & f -tt, || e, || 2 

- ej^-^y-^a^y -1 ^ + 2 £ ;y- 1 L i r ?i - 0, || ^ |f 



+ 0i\\ Vi\\ 2 -0i\\ e t f 



Using the following identity 

JV 

EE 

one has 



TV 



i?A + Q, 



IV 

: E< 



» 112) 



(30) 



o 



^^dt < - V / eUXfK'RK + Q l )e l dt 
o at ^— ' /" 



(=i 

N ,t 



E^ 

i=i 

JV 



6 II 2 - II e« II 2 )* 



where 0, = ^ 0j 



+EM (ii ^ ii 2 -En ^ ii 2 )* 

Finally, using the IQCs (O and ([TTj and V(e(t)) > 0, we 
obtain 

V / e'^K'RK + QJeidt < E(^ + W - !)) d 
i=i ^ i=i 

+ U(e(0)). (31) 

The expression on the right hand side of the above inequality 
is independent of f;. Letting ti — » oo leads to 

JV JV 

< + ^ 0i(AT - l))d + V(e{0)). (32) 

i=l i=l 

Also d32b holds for arbitrary collection of inputs ^, r\i that 
satisfy ( fT6l ), ( fTTT i, respectively. Then we conclude that 

JV JV 

sup J(u) < V((^ + V 6dN - l))d + eKOjy-^O)). 

— TT 

i=l 

(33) 



i=i 



The result of the theorem now follows from Lemma Q] and 
dH. ■ 

According to Theorem Q] one has to solve N coupled 
LMIs to obtain the control gain K. To simplify the calcula- 
tion, we establish the following theorem which requires only 
one LMI to be feasible, as follows 



Z 

(\Q) 1/2 y 

Y 
Y 



Y(XQ) 1/2 
-I 





Y 






Y 



1 r 



< 0, 



(34) 



where 



2 



and 



p = max(p, 

i 

q 2 = max(q 2 ) 

i 

A = min(Ai) 

i 

A = max(Ai) 

i 

A 2 

AY + YA' - =-B 1 R~ 1 B' 1 - 
X 2 



r p 2 



B 2 B' 2 . 



Lemma 2: Given R = B! > and Q > 0, suppose the 
LMI 01 in variables Y = Y' > 0, tt" 1 > and 0- 1 > 
is feasible. Then the matrices and constants 

Y, F = —^R- 1 B[, m=K, 0i=6 (35) 

are a feasible set of matrices and constants for the collection 
of LMIs 05]). 

Proof: Using the Schur complement, the above LMI 
( |34l is equivalent to the following Riccati inequality 



A 

AY + YA' - =-B 1 R- 1 B[ 4 
X 2 _ 

+ Y[XQ + (ir + 6)I]Y < 0, 



n 9 



B2B2 



Noting that XfF'R- 1 F < X 2 F'R- 1 F, we obtain the Riccati 
inequality ( f27T > which is equivalent to (1251 1, ■ 
Theorem 2: Given R = R' > and Q > 0, suppose 
the LMI OH in variables Y = Y' > 0, tt" 1 > and 
6> _1 > is feasible. Then the control protocol 0} with 
A" = —-= I R~ 1 B' 1 Y~ 1 solves Problem [T] Furthermore, this 
protocol guarantees the following performance bound 

N 

sup J(u) < N{Tr + e(N-l))d + Y J 4^)y 1 e l (0). (39) 

H ° i=1 1-1 

Proof: The proof readily follows from Lemma |2] and 

Theorem [T] ■ 

IV. Example 

To illustrate the proposed method, consider a system 
consisting of three identical pendulums coupled by two 
springs. Each pendulum is subject to an input as shown in 
Fig. Q] The dynamic of the coupled system is governed by 
the following equations 

ml 2 a\ = — ka 2 {a\ — a.2) — mglai — Ui, 

ml 2 a.2 = — ka 2 (a2 — 03) — ka 2 (a.2 — a\) (40) 

— mgla2 — u 2l 
ml 2 ay, — — fca 2 («3 — (X2) — mgla^ — W3, 

where / is the length of the pendulum, a is the position of 
the spring, g is the gravitational acceleration constant, m is 
the mass of each pendulum, and k is the spring constant. 

In addition to the three pendulums, consider the leader 
pendulum which is identical to those given. Its dynamics are 
described by the equation 



mPctQ = —mglao. 



(41) 



(36) 



Choosing the state vectors as xq = (a>o,ao), xi = (a.i,a-\), 
x 2 = («2, 0-2) an d £3 = (^3, 013), the equation ( |40b and (|4TT > 
can be written in the form of ((TJ, 0) > where 



1 

-f 



where 6 = (N - 1)9. 
Since A < Ai < A, 



implies that 



AY + YA' - Xi ^B 1 R- 1 B[ - X i ^B 1 R- 1 B[ 



A 

A : 



-B\R B[ 



IT 



B 2 B' 2 



+ Y[X l Q+(ir + 6)I]Y < 0. 



(37) 



Substitute F = -±R~ 1 B' 1 , m = ir 



1)9 = £ 6u and "let pj = (f L 
(J2 f?j) - Q 2 > tnen we obtain 



i = 9,9i = (N - 
Xi) 2 < p 2 and q 2 = 



AY + YA' + X i F'B' 1 + XiBiF + X 2 F'Rr 1 F 

2 -2, _ (38) 

B 2 B 2 + Y[X t Q + (vr, + 9 t )I]Y < 0. 



+ 



and 



Bo = 



1 

ml' 2 



<p(Xj 





_aL n 

ml 2 u 



k(xj 



The parameters of the coupled pendulum system are 
chosen as m = 0.25kg, I = Ira, a = 0.5m, g = 10m/ s 2 , 
< k < lN/m. 

The communication topology of the coupled system is 
an undirected graph, shown in Fig. [2] Suppose agent 1 is 
equipped with sensors which allow it to observe the leader. 



Fig. 1. Interconnected pendulums. 



.0__0_(3) 



Fig. 2. Communication graph. 



Then the Laplacian matrix of the graph consisting of nodes 
1, 2 and 3 and the pinning matrix G can be described by 
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-1 
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-1 
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1 








G 



























It is a straightforward to verify that C + G is a positive 
definite symmetric matrix. 

Two simulations are implemented for Theorem 1 and 
Theorem 2, respectively. We use the same initial conditions 
and the matrixes Q = I and R = 0.1. A computational 
algorithm based on Theorem 1 yields the gain matrix K = 
[3.9870, 4.5178]. For this gain, we directly computed the cost 
function © to yield J(u) = 2.1018. 

The second simulation is based on Theorem It involves 
solving the decoupled LMIs. Using the same matrices Q 
and R, and the same initial conditions, the control gain 
matrix was computed to be K = [1.3758, 10.4192], and 
the cost function was computed numerically to be equal 
J(u) = 4.9072. 

In this example, the conservatism is manifested by a 
greater synchronization time. Compared with the method 
based on Theorem 2, the method based on Theorem 1 enables 
the follower to synchronize to the leader in a much shorter 
time, with a better guaranteed performance. 

V. Conclusions 

The guaranteed consensus tracking performance problem 
for a coupled linear system with undirected graph has been 
discussed in this paper. This problem was transformed into 
a decentralized control problem for a system, in which 
the interactions between subsystems satisfy IQCs. This has 
allowed us to develop a procedure and sufficient conditions 
for the synthesis of the tracking protocol for the original 
system. 



Agent 1 

Agent 2 

Agent 3 



Fig. 3. Relative angles (the top figure) and relative velocities of the agents 
with respect to the leader, obtained using the algorithm based on Theorem[TJ 



According to the simulation results, the proposed com- 
putational algorithm based on Theorem 1, which solves N 
coupled LMIs, guarantees a better performance. However, 
the proposed computational algorithm based on Theorem 2 
only requires decoupled LMIs to be feasible, which enables 
the controller gain to be computed in a decentralized manner. 
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